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[0004] 



A METHOD AND SYSTEM FOR 

ASSESSING THE QUALITY AND 
COST OF INSPECTION 



This invention relates generally to the assessing the quality and cost of 
inspections. More specifically, the present invention is directed to a method, system, 
and software for factoring costs associated with inspection levels and results for 
assessing and optimizing the overall cost associated with inspections. 

Controlling the number of product defects has become important part of 
managing the costs and efficiencies associated with manufacturing and distribution 
processes. Inspection is often used to measure the variation in products as a method 
to control the number of escaping defects. Unfortunately, inspection is often an 
imperfect and sometimes expensive process. Product measurements are often 
corrupted by noise introduced by the measurement or gaging process. Furthermore, 
there is a lack of systems for evaluating and managing an inspection process so as to 
trade off the costs of inspection, re-inspection, scrap/rework of products identified as 
defective and the often large costs associated with escaping defects. 

Previously known methods of analyzing the inspection process do not enable the 
timely, accurate, and efficient calculation of various tradeoffs between inspection 
accuracy, product specification or tolerance limits, inspection limits, and/or 
multistage inspection. These methods do not enable the convenient evaluation of an 
inspection process where the measurement error is dependent on the size of the 
permissible variation of the product characteristic being measured. 

In particular, the quantitative results of making inspection limits more restrictive 
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than specification limits and/or performing multistage inspections have not been 
available except through time consuming simulation analysis. Running accurate 
simulations can be very time consuming during inspection tradeoff optimization 
determination particularly in ranges where the emphasis is on allowing only a few 
defects per million to pass through. 

BRIEF DESCRIPTION OF THE INVENTION 

[0005] In one aspect, the present invention provides a computer implemented method of 
assessing the cost tradeoffs associated with performing inspection, including: 
determining measurement variations and product characteristic variations to define an 
inspection plane; dividing the inspection plane into a plurality of regions 
corresponding to respective different outcomes resulting from an inspection process; 
determining the probability of each outcome based on the probability mass in each 
region of the inspection plane; associating costs to various outcomes based on the 
inspection process; and computing overall costs of the inspection process by using 
the associated costs and the determined probability of each outcome based on the 
regions of the inspection plane. 

[0006] In another aspect, the present invention further comprises optimizing the 

computed overall costs by varying the costs associated with the various outcomes 
and/or by varying the permissible product characteristic variation limits. 

[0007] In one aspect, the present invention provides for optimizing the computed overall 
costs by using an inspection limit that is different from the permissible product 
specification limit. 

[0008] In one aspect, the present invention provides that the step of determining the 

probability of each outcome comprises determining a joint probability density of the 
measurement variation and the product characteristic variation. 

[0009] In one further aspect, the present invention provides performing a second 

inspection on all products rejected in a first inspection wherein the second inspection 
alters the measurement variations. 



[0010] 



In another aspect, the present invention provides a system for assessing the cost 
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tradeoffs associated with performing inspections, comprising: an input unit for 
receiving input measurement variations, product characteristic variations, and costs of 
various outcomes based on an inspection process; and a computing unit configured 
to: define an inspection plane based on the input measurement variations and the 
product characteristic variations; divide the inspection plane into a plurality of regions 
corresponding to the respective different outcomes resulting from an inspection 
process; determine the probability of each outcome based on the probability mass in 
each regions of the inspection plane, wherein the probability mass is determined 
based on the joint probability density of the measurement variation and the product 
characteristic variation; and computing overall costs of the inspection process by 
using the associated costs and the determined probability of each outcome based on 
the regions of the inspection plane. 

[001 1] In yet another aspect, the present invention provides a computer readable data 
storage medium having program code recorded thereon for assessing the cost 
tradeoffs associated with performing inspections, the program code causing a 
computing system to perform steps comprising: determining measurement variations 
and product characteristic variations to define an inspection plane; dividing the 
inspection plane into a plurality of regions corresponding to respective different 
outcomes resulting from an inspection process; determining the probability of each 
outcome based on the probability mass in each region of the inspection plane, 
wherein the probability mass is determined based on the joint probability density of 
the measurement variation and the product characteristic variation; associating costs 
to various outcomes based on the inspection process; and computing overall costs of 
the inspection process by using the associated costs and the determined probability 
of each outcome based on the region of the inspection plane. 



BRIEF DESCRIPTION OF THE DRAWINGS 



[0012] 



The accompanying drawings, which are incorporated in and constitute a part of 
the specification, illustrate a presently preferred embodiment of the invention, and, 
together with the general description given above and the detailed description of the 
preferred embodiment given below, serve to explain the principles of the invention. 



[0013] 



Figure 1 is a diagram illustrating an inspection plane. 
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[0014] Figure 2 is a diagram that illustrates divisions of the inspection plane. 

[001 5] Figure 3 is a diagram that illustrates that the inspection plane is divided into 
regions corresponding to four outcomes of the inspection process. 

[0016] Figure 4 illustrates tables used in building a product cost model. 

[001 7] Figure 5 is a diagram illustrating tighter inspection limits. 

[001 8] Figure 6 shows tables disclosing probabilities of outcomes in a two stage 
inspection process. 

[001 9] Figure 7 shows a table for calculating the cost of an inspection process. 

[0020] Figure 8 shows an exemplary operator input interface for inputting various 
parameters for the inspection process. 

[0021] Figure 9 is diagram illustrating a plot of the specification and inspection limits 
together with an exemplary mathematical distribution or errors. 

[0022] Figure 1 0 shows a result table after a first inspection. 

[0023] Figure 1 1 illustrates an input interface for entering parameters for a second 
inspection. 

[0024] Figure 12 is a graph illustrating a probability density plot for a second inspection. 

[0025] Figure 1 3 shows a result table after the second inspection. 

[0026] Figure 14 illustrates a cost model for the two step inspection. 

[0027] Figure 1 5 is a table illustrating optimized values for cost for a one step and a two 
step inspection. 

DETAILED DESCRIPTION OF THE INVENTION 

[0028] j n one aspectt t h e evaluation or assessment of an inspection process involves 
finding the probabilities of four exemplary possible inspection outcomes: (1) a 
product specification characteristic within its specification limit is accepted; (2) a 
product specification characteristic outside of the specification limit is rejected; (3) a 
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product within specification is rejected; and (4) a product outside of the specification 
is accepted. Outcomes (1) and (2) are the desired results of an inspection process 
since "good" products are accepted and "bad" products are rightfully rejected. 
Outcome (3) implies that a good product is rejected giving rise to costly and time 
consuming rework (or scrapping) for a product that is within the specification limits. 
Outcome (4) is generally very undesirable since it means that a defective product is 
escaping. Depending on the type and criticality of the product such a defective 
escaped product can give rise to considerable liability or otherwise generate bad 
publicity for the manufacturer or distributor. The method, system, and software 
discussed herein provides an efficient method for quickly and accurately evaluating 
the four possible outcomes in different inspection situations and relating the 
outcomes to average inspection related product costs. 

[0029] With reference to the figures, Figure 1 shows a representation of a product 

specification characteristic variation (c) axis 1 05 and a measurement variation or error 
(m) 103 to define an inspection plane 101 that is centered with its origin at 107. The 
origin 1 07 represents the case where the product is exactly right and the 
measurement is also perfect. Moving horizontally from the origin along the axis 103 
represents an error in the measurement system while moving vertically along the axis 
105 represents an error in a product's characteristic. If the product characteristic 
variation falls within the range defined by a upper specification limit 109 and a lower 
specification limit 111, then the product is considered to be acceptable. If not, a 
defect has occurred. Therefore, a point in the inspection plane 101 represents a 
combination of a product characteristic variation 105 and a measurement variation 
error (or variation) 103. 

[0030] Figure 2 is a diagram that shows two sloping lines 121 and 123 in the inspection 
plane. The first sloping line 123 is defined by all points such that the sum of their 
respective values (c and m) along the product specification variation axis 1 05 and the 
measurement error (or variation) axis 1 03 equals the upper specification limit 1 09. 
Likewise, the second sloping line 1 21 is defined by all points such that the sum of 
their respective values along the product characteristic variation axis 1 05 and the 
measurement error (or variation) axis 1 03 equals the lower specification limit 111. 
Any combination of the values of c and m that lies between these two sloping lines 
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121 and 123 represents a measurement within the specification limits while 
combinations that lie outside these lines represent a measurement outside the 
specification limits. 

[0031] As shown in Figure 3, the sloping lines 121 and 123 and the upper and lower 
specification limit lines 1 09 and 111, allow the inspection plane to be divided into 
regions corresponding to the four outcomes discussed earlier herein. To evaluate the 
probability of each of the four inspection outcomes, a joint probability density of the 
product specification variation and the measurement variation is defined. For 
example, the joint probability density may be computed by assuming that product 
specification variation values and the measurement variation values follow a known or 
assumed mathematical distribution that is characterized by corresponding 
mathematical parameters. As one example, the variation values may be assumed to 
follow a normal distribution that is characterized by parameters such as a central 
value and a standard deviation. Other similar mathematical distributions and their 
parameters are known to skilled in the art and may also be used as would be apparent 
to those skilled in the art. The probability of each outcome is then found by summing 
theprobability "mass" in each region. The concept of probability mass based on the 
joint probability density in a region is within the knowledge of those skilled in the art 
as exemplified by the discussion in the text "Probability, Random Variables, and 
Stochastic Processes," by Athanasios Papoulis (McGraw Hill, 1964), the contents of 
which are incorporated herein in its entirety. 

[0032] Figure 3 shows a simple inspection situation where the inspection limits are 
placed at the specification limits. However, inspecting using such a system often 
allows an unacceptable number of escaping defects since measurement noise or error 
can easily make products that are outside the specification limits to erroneously 
measure within the specification limits. As shown in region 1 3 7, "bad" products are 
measured as being good using such a system. In contrast, region 131 indicates good 
products that are measured as being good. Regions 135 indicates that good products 
are measured as being bad giving rise to unnecessary rework or replacement while 
region 1 33 represents that bad products are correctly measured as being bad. 

[0033] 

As shown in Figure 4, a product cost model is built using the probability of each 
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inspection outcome as shown in tables 401 and 41 1 in Figure 4. Table 401 identifies 
the probabilities of the different inspection outcomes derived by summing the 
probability masses as described earlier herein. Table 41 1 illustrates how the 
probabilities of table 401 along with the costs associated with the various inspection 
stages (or events) are used to calculate the overall cost associated with the inspection 
process. The different inspection stages (and costs associated therewith) include: 
product inspection, product scrapping or rework for products that are rejected by the 
inspection process, costs associated with defective products that escape through he 
inspection process, and finally unnecessary rework associated with good products that 
are erroneously identified as being bad by the inspection process. It should be noted 
that the probabilities of outcomes are determined by the inspection process and can 
only be changed by changing the inspection process. 

[0034] To reduce the number of escaping defects, inspection limits can be set within the 
product specification limits, as illustrated in Figure 5. Accordingly, a lower inspection 
■i. limit (LIL) 1 1 2 and upper inspection limit (UIL) 1 1 0 may be set that are narrower than 
the lower specification limit 1 1 1 and the upper specification limit 1 09. In fact, for 
many inspections situations, the inspection evaluation method disclosed above reveals 
that more restrictive inspection limits must be employed to assure that only an 
acceptably small number of defects escape. Figure 5 shows that by making inspection 
limits 1 1 0 and 1 1 2 more restrictive than the specification limits 1 09 and 1 11 , the area 
of the "bad product measures good" region 1 37 is diminished because the distance 
between the inspection limits 1 25 and 127 is reduced while the specification limits 
remain the same. Therefore , fewer defective products will erroneously escape the 
inspection process. At the same time, however, additional good product that is within 
the specification limits will be rejected as indicated by the expanded region 1 3 5. 

[0035] The method disclosed earlier herein for inspection against specification limits can 
extended to the tighter inspection limits illustrated in Figure 5. Just as shown as 
discussed earlier with respect to Figure 3, the four regions of possible inspection 
outcomes are determined and then the joint probability mass in each of the regions is 
summed. Tables 401 and 41 1 are still used to describe the probabilities and unit 
product cost for the inspection process, although the probabilities in Table 401 will 
change as a function of the inspection limits UIL 1 1 0 and LIL 112. 
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[0036] With the introduction of inspection limits, well known optimization techniques can 
now be applied to minimize the average cost per unit for a product. Therefore, by 
varying the inspection limits and the associated costs, the average cost per unit 
product can be derived and optimized so that an optimal inspection limits are derived. 

[0037] Of course, in many situations the cost of an escaping defect may include 

intangibles or may be difficult to quantify (loss of reputation, uncertain legal liability, 
for example). In such situations, optimization can be still be achieved with a 
maximum number of allowable defects operating as a constraint to the optimization 
process. 

[0038] The inspection analysis disclosed herein can be extended to a two-stage 

inspection process. In such a process, a first inspection is made and rejected units are 
then subjected to a second inspection. In practice, the first inspection may be a low- 
cost screening method, while the second is a more costly and precise method. To 
evaluate the two-stage inspection, the probability density function for the population 
of rejected units is calculated and used in the same manner as the density function in 
the one-stage analysis. As would be expected, the density function for rejected units 
is highest near the inspection limits. Accordingly, as shown in table 601 in Figure 6, 
the probabilities pi 1 -pi 4 of outcomes for the first inspection and as shown in table 
61 1 , the probabilities p21 -24 of the same outcomes for the second inspection are 
computed or derived as discussed earlier herein. 

[0039] 

As shown in table 701 in Figure 7, the cost per unit product per inspection event 
for the two step inspection is calculated. As shown in the table, costs CI1 and CI2 are 
associated with the first and second product inspection with the CI2 typically being 
greater than Cll . The second inspection is only done on products that fail the first 
inspection (probability pi 2 + pi 3). Likewise, product scrap rework is only done of 
products that fail the second inspection (probability p22 + p23). The probability of an 
escaping defect is pi 4 + p24 (i.e., defective products that are passed in either of the 
two inspection steps). Finally, the probability of unnecessary rework should be 
reduced to the probability p23 based on the better quality second step inspection. 
Multiplying these probabilities by the respective costs yield a cost per unit product for 
the inspection process. In the two step inspection process, the cost associated with 
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the second inspection is offset by the reduction in unnecessary rework of good 
products that are indicated as being bad in the more low cost first inspection step. As 
before, the two step inspection process can also be optimized by varying the various 
cost and inspection process parameters to achieve an optimized result. 

[0040] Figures 8-14 illustrate one exemplary embodiment of assessing the cost of 

inspection in a two step inspection process. The inspection process evaluation method 
described in this exemplary embodiment has been implemented in a standard desktop 
computer using a common spreadsheet software program having a computing engine 
and an optimizer. 

[0041] Figure 8 shows exemplary operator input interface 801 for inputting various 

parameters for the inspection process. Some of the parameters input include: process 
standard deviation, process center, a lower specification limit (LSL), an upper 
specification limit (USL),.a calculated specification center, a lower inspection limit (LIL), 
an upper specification limit (UIL), a calculated inspection center, and a measure of 
gage or measurement error for a particular type of inspection to be used. 

[0042] Figure 9 is diagram illustrating a plot of the specification (109, 111) and 

inspection limits (110, 112) together with an exemplary mathematical distribution of 
gage error 901, the measurement variation error 905 , and the product specification 
variation 903 based on a normal distribution using the parameters entered using the 
interface 801. It should be understood that the normal distribution is discussed herein 
but other known distributions, for example, uniform, gamma, or otherwise, may be 
used as would be recognized by those skilled in the art. 

[0043] As soon as the inputs are completed, the table 1001 as shown in Figure 10 is 
generated and displayed. This table 1001 is equivalent to the table of probabilities 
discussed earlier herein , with "parts per million" notation replacing probability. This 
nomenclature is consistent with notation commonly used in the discussion of 
inspection processes. 

[0044] 

Figure 1 0 shows a table 1 001 that illustrates the effect of setting inspection limits 
so that only a few bad products escape. In this case, where the gage is relatively noisy 
(40% gage R&R), as much as 17% of the good product is rejected. Scraping or 
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reworking this much good product may be expensive. 

[0045] By reinspecting the rejected units with a second, less noisy gage, the amount of 
good product scrapped or reworked can be reduced. This reinspection may be cost 
effective, even if the second inspection process is more expensive than the first. Using 
the exemplary input interface 1 1 01 , an operator input the parameters for the second 
inspection as shown in Figure 1 1 . The density function 1 201 for the product 
characteristic at the second inspection, which is derived for product rejected by the 
stage one inspection, and the gage noise 1203 for the second inspection are plotted 
in Figure 1 2. The second inspection limits 1 1 3 and 1 1 4, the specification limits 1 09 
and 1 1 1 and the first inspection limits 1 1 0 and 1 1 2 are also shown. 

[0046] Figure 1 3 shows the results 1 301 for the exemplary second inspection. By using 
this second inspection, the rejected good product is down to 2% of the original one 
million while the additional escaping defect count per million has increased by only 
one. 

[0047] The cost model 1401 for the two-stage inspection is shown in Figure 14. The 

additional cost of a second inspection has been added to the table. Cost impact of the 
second inspection can be seen in the total cost table, where average cost of the 
product has been reduced from $1 2.04 (with only one inspection) to $1 1 .67 (with two 
inspection). This additional savings comes about by reducing the amount of scrap and 
rework even though the second inspection itself adds cost since a better (and 
generally more expensive) inspection technique is used in the second inspection. 

[0048] Figure 1 5 shows the exemplary results 1 501 of optimizing the two stage (or step) 
inspection to minimize the total average product cost. The. cost structure is the same 
assumed in the table 1401 shown in Figure 14, with total escaping defects 
constrained to be 3.4 per million which is a low number. The optimizer varied both 
the first and second stage inspection limits to arrive at the minimum average cost. 
Either custom built optimizing algorithms or a commercially available optimizer (such 
as that provided with Microsoft Excel's spreadsheet product) may be used as would be 
recognized by those skilled in the art to achieve the optimization of cost by varying 
the various inspection level and cost related parameters. 
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[0049] One skilled in the art would recognize that computing units and input units that 
comprise the system provided herein may be connected through a general purpose 
electronic network, such as a computer network. The computer network can be a 
public network, such as the Internet. The computing unit may include a computer 
system including a central processing unit (CPU) connected to a system memory. The 
system memory typically contains an operating system, a BIOS driver, and application 
programs and system programs. In addition, the computer system contains input 
devices such as a mouse or a keyboard, and output devices such as a printer and a 
display monitor. The computer system generally includes a communications interface, 
such as an Ethernet card, to communicate to the electronic network. Other computer 
systems may also connect to the electronic network which can be implemented as a 
Wide Area Network (WAN) or as an inter-network such as the Internet. 

[0050] One skilled in the art would recognize that the above describes a typical computer 
system connected to an electronic network. It should be appreciated that many other 
similar configurations are within the abilities of one skilled in the art and it is 
contemplated that all of these configurations could be used with the inspection 
quality and cost assessment system and method discussed herein. Furthermore, it 
should be appreciated that it is within the abilities of one skilled in the art to program 
and configure a computing system or unit to implement the method steps discussed 
herein. 

[0051] Other embodiments of the invention will be apparent to those skilled in the art 
from a consideration of the specification and the practice of the invention disclosed 
herein. It is intended that the specification be considered as exemplary only, with the 
true scope and spirit of the invention also being indicated by the following claims. 
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